Initializing RBF-Networks with Small Subsets of Training Examples
نویسندگان
چکیده
An important research issue in RBF networks is how to determine the ganssian centers of the radial-basis functions. We investigate a technique that identifies these centers with carefully selected training examples, with the objective to minimize the network’s size. The essence is to select three very small subsets rather than one larger subset whose size would exceed the size of the three small subsets unified. The subsets complement each other in the sense that when used by a nearestneighbor classifier, each of them incurs errors in a different part of the instance space. The paper describes the example-selection algorithm and shows, experimentally, its merits in the design of RBF networks.
منابع مشابه
Improving RBF Networks by the Feature Selection Approach EUBAFES
The curse of dimensionality is one of the severest problems concerning the application of RBF networks. The number of RBF nodes and therefore the number of training examples needed grows exponentially with the intrinsic dimensionality of the input space. One way to address this problem is the application of feature selection as a data pre-processing step. In this paper we propose a two-step app...
متن کاملGlobal Optimization of RBF Networks
Several modifications to parameter estimation in a Radial Basis Functions network are introduced. These include a better initializing clustering algorithm and a full gradient descent on centers and weights after weights were found via a matrix inversion. Performance comparison with other RBF algorithms is given on several data-sets. It is found that The proposed method was found superior to Bis...
متن کاملOrthogonal least square algorithm applied to the initialization of multi-layer perceptrons
An e cient procedure is proposed for initializing two-layer perceptrons and for determining the optimal number of hidden neurons. This is based on the Orthogonal Least Squares method, which is typical of RBF as well as Wavelet networks. Some experiments are discussed, in which the proposed method is coupled with standard backpropagation training and compared with random initialization.
متن کاملIeee Transactions on Neural Networks 814 + + + + + + + + + + + + - - - - - - - - - - - - -
| Successful implementations of radial-basis function (RBF) networks for classiication tasks must deal with architectural issues, the burden of irrelevant attributes, scaling , and some other problems. This paper addresses these issues by initializing RBF networks with decision trees that deene relatively pure regions in the instance space; each of these regions then determines one basis functi...
متن کاملNeural Network Performance Analysis for Real Time Hand Gesture Tracking Based on Hu Moment and Hybrid Features
This paper presents a comparison study between the multilayer perceptron (MLP) and radial basis function (RBF) neural networks with supervised learning and back propagation algorithm to track hand gestures. Both networks have two output classes which are hand and face. Skin is detected by a regional based algorithm in the image, and then networks are applied on video sequences frame by frame in...
متن کامل